
F/6. |<y£ 




FIG. 1G5 




Pl(5. KhT 



n<QJSt% C760-800nm) 
Over ZQftm Q-4-.3 

SO/5x0.063;Cl x0.4;Clx1 . 
fa. 



V 

s/ 




R<t» (760-BOOnnO / * 
eve/ xon« #4.8 



FIG.J<$ is 



T«atzon* 64,5 




m 




5 n~r n 



las' 




fcV Qit) 



*w 




2 



i — «> — ^ °) 








v 













F/$.l$iJE fie,. 16. OF 



The First Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 
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Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the spatial phase of the transmitted PLIB along the planar 
extent thereof according to a spatial phase modulation function (SPMF) so as 
to i 
produce numerous substantially different time-varying speckle-noise 
patterns at the image detection array of the IFD Subsystem during the photo- 
integration time period thereof. 



T Tei 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce the power of the speckle-noise pattern observed at the image 
detection array. 
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The Second Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 



Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal intensity of the transmitted PLIB along the 
planar extent thereof according to a temporal intensity modulation function 
(TIMF) so as to 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the BPD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array. 
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Tht/L& Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 



O 
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Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal fk*r<? of the transmitted PLIB along^ftfe 
pk ^a^JjJ^ai^L^ according to a T«*f°^L . p^*re modulation function 

(TPMF) so as to 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array. _ 
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fc^rfk Generalized Sp(**1ft-Noise Pa ttern Reduction Method 
" Of The Present Invention 



Prior to illuminatioii of the targe* with the planar laser Illumination beam 
(PLIB), modulate the temporal of the transmitted PLIB 

according to a temporal intensity modulation function 

(J &SF) so as to ( 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the BPD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantiaUy different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 



array. 
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Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 



Prior to illumination of the target with the planar laser illumination beam 
(PUB), modulate the spatial intensity of the transmitted PLIB along the 
planar extent thereof according to a spatial intensity modulation function 
(SIMF) so as to 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereof. 
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Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array. 



>(vr<f)t Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 
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After illumination of the target with the planar laser illumination beam 
(PLIB), modulate the spatial intensity of the reflected/scattered (Le. received) / 
PLIB along the planar extent thereof according to a spatial intensity/ 
modulation function (SIMF) so as to • 

produce numerous substantially different time- \ 
varying speckle-noise patterns at the image detection array of the IFD \ 
Subsystem during the photo-integration time period thereof. I 



Temporally average the many substantially different time-varying speckle- 
noise patterns produced at the image detection array in the IFD Subsystem 
during the photo-integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 
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-^ley^k Generalized Speckle-Noise Pattern Reduction Method 
~* Of The Present Invention 



After illumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal intensity of the reflected/scattered (i.e. 
received) PLIB along the planar extent thereof according to a temporal 

i 

intensity modulation function (TIMF) so as to 

. produce many substantially different 
time-varying speckle-noise patterns at the image detection array of the IFD 
Subsystem during the photo-integration time period thereof. 



Temporally average the many substantially different time-varying speckle- 
noise patterns produced at the image detection array in the EPD Subsystem 
during the photo-integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. 
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FIGHT GENERALIZED METHOD OF REDU CING THE SPECKLE PATTERN 
NOIRE OBSERVED IN PLUM-BA RED IMAGING SYSTEMS 



A 



Use a PLIIM-BASED Imager to produce a series of consecutively 
captured digital images of an object over a series of photo-integration 
time periods of the PLIIM-Based Imager, wherein each digital image of 

the object includes a substantially different speckle noise pattern 
produced by natural oscillatory micro-motion and/or forced oscillatory 
micro-movementof the Imager relative to the object during operation of 

the PLIIM-Based Imager. 



Store the series of consecutively captured digital images of the object in 
buffer memory within the PLIIM-Based Imager. 



A 

c 



Add relatively small (e.g. 3x3) windowed image processing filters to the 

additively combine and average the pixel data in the series of 
consecutively captured digital images so as to produce a reconstructed 
digital image having a speckle noise pattern with reduced RMS power. 



FIG. 1I24D 
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NINTH GENERALIZED METHOD OF REDUCING SPEC KLE PATTERN 
NOISE IN PLIIM-BASED IMAG ING SYSTEMS 



During each photo-integration time period of a PLIIM-Based Imager, 
produce numerous substantially different spatially-varying speckle noise 
pattern elements (i.e. speckle noise pattern elements at different points) 

on each image detection element in the image detection array of the 

PLIIM-Based Imager. 



B 



Spatially (and temporally) average said spatially-varying speckle-noise 
pattern elements over the spatial area of each image detection element, 
/ thereby reducing the RMS power of speckle-pattern noise observed in 

said PLIM-Based Imager. 
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Image distance vs object distance 
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Pixel power density vs. object distance (general example) 
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Figure 6; Pixel power densities vs. object distance 
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/ identification^ 
/ of Object Using 
/ 'Flying 0 

Spot Laser 
I Scanning 
\ Beam 
: \ Techniques > 






7 Acquisition \ 
J of 1 

Object 
1 Dimensions i 
\ Only / 


A. : 
Specification of Object j 
Detection and : 
Tracing Capability of • 
System \ 


B. : 
Specification of Object j 
Identification : 
Capability of System j 


C. 

Specification of 
Object Attribute 
Acquisition Capability 
of System 
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G 



Specify object detection and tracking capabilities of PLUM- based network , system, 

and/or subsystem. 



Specify object identification capabilities of PLIIM-based network , system, and/or 

subsystems. 



Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 

or subsystem . ___ 



Determine the configuration of hardware components required to build the configured 
system or network. 



Determine the configuration of software components required to build the configured 

system or network. 



The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 



The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 



H 



± 

Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 

with or without remote service assistance made available through the remote 
monitoring, configuring, and servicing system of the present invention, illustrated in 

Figs. 30A through 30D2 
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PLLIM-B ASED PACKAGE IDENTIFICATION AND 
DIMENSIONING (PID) SYSTEM 



LDIP Package 
Dimensioner with 
Integrated Package 
Velocity Detection 



Image Processing Computer 
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Auto-Focus/Auto-Zbom 
Digital Camera 



Camera Control Computer 
Subsystem 

(Figs. 24A, 24B, 25, 26, 27, 
28,29) 



Package 
Velocity 
► 



Real-Time Package Height 
Profiling and Edge- 
Detection Processing 
Module 

(Figs. 21,22,23) 
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LDIP Subsystem (122) 
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FIG. 14 



LDIP REAL-TIME PACKAGE HEIGHT PROFILE AND 
EDGE DETECTION METHOD 
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Analyzc intensity data values {R(nt» and 
determine the X coordinate position range X*,, 

(in R global) where the height intensity 
changes (i) within the spatial bounds (Xu^, X^) 
and (ii) beyond predetermined height intensity 
data thresholds. 



Create time-stamped data set (X^ h, X RPE> V B , 
nT} by assembling package left-edge coordinate 
(LPE), current package height (h), package right 
edge coordinate (RPE), X coordinate subrange 
where height values exhibit maximum intensity 
chants, package velocity (Vb), and time stamp 



Send hextuplc data set to camera control 
computer. 



Raw data is received every 5ms; plus rime stamp 




f 


Convert raw data into range profile 
R=f(inL phase], referenced with respect to Polar 
Coordinate System symbolically embedded in 
LDIP Subsystem. 


y 


f 


Use Geometric transformations 

h[i] » R[i]sin(ang - 90) and 

x[i] « Rp]tan(ang - 90) to convert range profile 

R[i] into height h[i] and position x[i] data. 




r 


Obtain current package height by finding 
prevailing height using edge detection without 
filtering (Fig- 16). 




r 


Find the coordinates of the left and right edges of 
package (LPE, RPE) by searching for the closest 
coordinates from the edges of the belt (X,, X^) 
toward the center thereof. 


1 


r 



LDIP Package Dimensioner with Integrated Velocity 
Detection 



Real-Time Package 
Height Profiling and 
Edge Detection 
Processing Module 



belt velocity 



Fig. 15 



LDIP Real Time Package Edge Detection 




Exit 



Xa - location of belt left edge; Xb » location ofbelt right edge 
la - belt edge edge pixel; lb = belt right edge pixel 
LPE = Left package edge; RPE « Right package edge " 
HQ = Pixel height array, XQ - Pixel location array 
win = package detection window 



LDIP Subsystem (122) 



-Polar Coordinate System 
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conveyor belt 
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Global' Cartesian 
Coordinate 
System 
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INFORMATION MEASURED AT SCAN ANGLES BEFORE 
COORDINATE TRANSFORMS 
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'2 RANGE AND POLAR ANGLE MEASURES TAKEN AT SCAN 

£ ANGLE a BEFORE COORDINATE TRANSFORMS 
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MEASURED PACKAGE HEIGHT AND POSITION VALUES 
AFTER COORDINATE TRANSFORMS 



H[ ] 

Input height after 
coordinate transforms 




x(02) 

height value yCc^) and 
position value xCotj) 
measured at left belt edge 



CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE CAMERA 
CONTROL SUBSYSTEM OF EACH OBJECT IDENTIFICATION AND 
ATTRIBUTE ACQUISITION SYSTEM O F PRESENT INVENTION 

Start 

A 



Camera Control Computer receives a time-stamped quintuple Data Set (i.e. coordinate 
of Left Package Edge, coordinate of Right Package Edge, height, velocity, and time 
stamp) from the LDIP Subsystem and stores the Data Set in a Package Data Buffer 
Structure having N=5 columns and M rows; Camera Control Computer optical power 
(milliwatts) which each PLIA must produce (using method in Figs. 18C), and transmits 
the computer optical power to each PLIA and dependent system. 



B 



Camera Control Computer analyzes height data in the Package Data Buffer and detects 
the occurrence of detecting discontinuities, and based on such detected height 
discontinuities, determines the corresponding coordinate position of the leading 
package edges by left-most and right-most coordinate values associated with the data 
set at this detected height discontinuity. 



© 



Camera Control Computer determines the height of the package 
associated with the leading package edges determined at Block B above. 



N 



Camera Control 
Computer transforms 
the position of left and 

right package edge 
(LPE, RPE) coordinates 
buffered in the deepest 
row of the Data Package 
Buffer at which the 
height value was 
determined at Block D 
to a Global Coordinate 

Reference System 
symbolically embedded 
in the conveyor belt 
structure beneath the 
LDIP Subsystem, as 
shown in Fig. 17. 



Camera Control Computer 
analyzes the height values 
(i.e. coordinates) computed 
over previous raw data set 

processing cycles, and 
stored in the Package Data 
Buffer, and determines the 
"median" height of 
package, as well as the 
average "slope" of the 
package's laser scanned 
surface. 



K 



Camera Control 
Computer analyzes 
height value in the 
Package Data 

Buffer, and 
determines the 

speed of the 
package (V b (t)). 



© © c 



FIG. 18A 



Camera Control Computer detects the x- 
coordinates of the package boundaries based 
on the spatially-transformed coordinate values 

of the left and right package edges (LPE, 
RPE) buffered in the Package Data Buffer. 



Based on x-coordinates of the detected 
package boundaries (and optionally, the 

subrange of x-coordinates over which 
maximum range "Intensity- data variations 
have been detected by the lens data of Fig. 
15) determined at block O, the Camera 
Control Computer determines the 
corresponding pixel indices (i, j) in the Image 
Buffer which specify the image frame (i.e. 
region of interest) to be cropped from the 
image(s) to be subsequently captured by the 
IFD Subsystem. 



Camera Control Computer transmits Lens 
Group Moves Commands to the IFD 

Subsystem. 



IFD Subsystem uses the Lens Group 
Movement Commands to move the lens 
groups to their desired positions. 



H 



Camera Control Computer checks 
resulting positions of moved lens 
groups. 



Camera Control Computer uses Focus/Zoom 

Lookup Table In Fig. 21 to determine the 
focus and zoom lens group positions based 
on the height of the package determined at 
block D. 



Camera Control Computer corrects lens 
group positions. 




Camera Control Computer uses the 
computed values of median package height, 
belt speed and the Photo-Integration Time 
Lookup Table in Rg. 23 to determine the 
photo-integration time parameter which will 

ensure that "square" image pixels are 
produced in captured package images (i.e. 
pixels having a 1:1 ratio); Camera Control 
Computer also uses (i) computed belt speed/ 
velocity, (ii) the pre-specified image resolution 
(dpi), and (iii) computed "slope" of laser 
scanned surface so as to compute the 
surface-slope compensated Line Rate of the 
IFD subsystem that helps ensure that 
captured linear images have substantially 
constant pixel resolution (dpi) independent of 

the angular arrangement of the package 
surface during surface profiling and imaging 
operations. 



JML 



Camera Control Computer generates digital 
control signals for the compute parameters- 
Photo-lntegration Time Period and 
Compensated Line Rate- and thereafter 
transmits these digital control signals to the 
CCD image detection array in the IFD 
Subsystem. 



Camera Control Computer uses package 
time-stamp (nT) and package velocity (V ) to 
determine the "Start Time" of Image Frame 
Capture (STIC) 



Camera Control Computer uses (i) the Start 
Time of Image Capture (STIC) determined at 
Block Q, to generate a command for starting 
Image Frame Capture, and also uses (ii) the 
pixel indices (i,j) determined at Block P to 
generate commands for cropping the 
corresponding slice of the "region of interest" 
in the image being captured and buffered in 
the Image Buffer within the IFD Subsystem. 



Camera Control Computer transmits the 
command generated at Block R to the IFD 
Subsystem. 



FIG. 18B 
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METHOD OF COMPUTING OPTICAL O UTPUT POWER FROM CASE 

nmnFs in planar laser ilumina tion array (PLIA> FOR 

CONTROLLING CONSTANT W HITE LEVEL IN IMAGE PIXELS CAPTURED 
RY PI IIM-RASED LIN EAR IMAGER 



Compute the Line Rate of Linear Image Detection Array (dots/sec) 
based on computed Belt Velocity (inches/sec) and constant Image 
Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 



B' 



Compute the Photointegration Time ST of the Linear Image 
Detection Array based on the computed Line Rate using the 

formula: 



Photointegration Time Period = 1/Line Rate 



© 



FIG. 18C1 



0 



Compute the Optical Power (milliwatts) of each PLIA based on computed 
Photointegration Time Period (AT) using the following formula: 



Optical Power of VLD (milliwatts) = 



constant 



Photointegration Time Period AT 



FIG. 18C2 



MFTHOD OF COMPUTING COMPENSATED LINE RATE FOR CORRECTING 
X/IFWING-ANGLE DISTORTION OCCUR ING IN IMAGES OF OBJECT 
SURFACES CAPTURED A S OBJECT SURFACES MOVE PAST PU1M- 
RASFD LINEAR IMAGER AT NON -7FRO SKEWED ANGLE 



Compute the Line Rate of Linear Image, Image Detection Array 
(dots/sec) based on computed Belt Velocity (inches/sec) and 
constant Image Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 



Compute the Line Rate Compensation factor cosine (6 or 0), where 
6 and 0 is defined in Figs. 18E1 and 18E2 respectively as the 

computed average scope of the packages surface laser scanned by 
the AM laser beams powered by the LDIP subsystem, and is 
computed at Block D in Fig. 1 8A. 



▼ 

Compute the Compensated Line Rate for the IFD (i.e. camera) 
subsystem using the equation: 

Compensated Line Rate = (Line Rate) x Cos(6)) 



FIG. 18D 



CASE 1 : 

Tod Down Imaging 



Coplanar PLIB/FOV- 



3^120 



AM Laser Beams 




FIG. 18E1 



CASE 2: 
Side Imaging 



Coplanar 
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FIG. 18E2 



X coordinate subrange where 
maximum range "intensity" 
variations have been detected 
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Right Package Package 



Velocity 



Ti me-stam p 



Package Data Buffer (FIFO) 
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Columns 
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RowM 



Rows 
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Fig. 20 
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METHOD OF AND APPARATUS FOR P ERFORMING AUTOMATIC 
RECOGNITION OF GRAPHICAL INTELLIGENCE CONTAINED IN 2-D 
IMAGES CAPTURED FROM ARBITARY 3-D OBJECT SURFACES 



STEP 1 : At the unitary PLIIM-based object imaging and profiling system, 
use the laser doppler imaging and profiling (LDIP) subsystem employed 
therein to (i) consecutively capture a series of linear 3-D surface profile 
maps on a targeted arbitrary (e.g. non-planar or planar) 3-D object 
surface bearing forms of graphical intelligence and (ii) measure the 
velocity of the arbitrary 3-D object surface, wherein the polar coordinates 
of each point in the captured linear 3-D surface profile map are specified 
in a local polar coordinate system R LD , P/p0 , ar , symbolically embedded 
within the LDIP subsystem. 



STEP 2: At the unitary PLIIM-based object imaging and profiling system, 
use coordinate transforms to automatically convert the polar coordinates 
of each point p(a, R) in the captured linear 3-D surface profile map into 
x,y, z Cartesian coordinates specified as p(x,y,z) in a local Cartesian 
coordinate system RLDip/cartesian. symbolically embedded within the LDIP 
subsystem. 



STEP 3: At the unitary PLIIM-based object imaging and profiling system, 
use the PLIIM-based imager employed therein to consecutively capture 
high-resolution linear 2-D images of the arbitrary 3-D object surface 
bearing forms of graphical intelligence (e.g. symbol character strings), 
wherein (i) the x 1 , y' coordinates of each pixel in each said captured high- 
resolution linear 2-D image is specified in local Cartesian coordinate 
system R PLiiM/cartesian symbolically embedded within the PLIIM-based 
imager, and (ii) the intensity value of the pixel l(x\y') is associated with the 
x', y 1 Cartesian coordinates of the image detection element in the linear 
image detection array at which the pixel is detected, and (iii) wherein also 
the planar laser illumination beam (PLIB) of the PLIIM-based imager is 
spaced from the amplitude modulated (AM) laser scanning beam of the 
LDIP subsystem is about D centimeters. 




FIG. 23C1 
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STEP 4: At the unitary PLIIM-based object imaging and profiling system, 
capture and buffer the camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the corresponding 
photo-integration time period AT K , by the PLIIM-based imager. 



STEP 5: At the end of each photo-integration time period AT K , use the 
unitary PLIIM-based object imaging and profiling system to transmit the 
following information elements to the Image Processing Computer for 
data storage and subsequent information processing: 

(1) the converted coordinates x, y, z, of each point in the linear 3- 
D surface profile map of the arbitrary 3-D object surface captured during 
photo-integration time period AT«; 

(2) the measured velocity(ies) of the arbitrary 3-D object surface 
during photo-integration time period AT K ; 

(3) the x', y' coordinates and intensity value l(x',y') of each pixel in 
each high- resolution linear 2-D image captured during photo-integration 
time period DTk and specified in the local Cartesian coordinate system 

puiM/cartesiarw camera ()FD) parameters used to form and detect 

each linear high-resolution 2-D image captured during the photo- 
integration time period AT K 



STEP 6: At the Image Processing Computer, receive the data elements 
transmitted from the PLIIM-based profiling and imaging system durin Step 
5 buffer data elements (1) and (2) in a first FIFO buffer memory structure, 
and data elements (3) and (4) in a second FIFO buffer memory structure. 



FIG. 23C2 
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STEP 7: At the Image Processing Computer, use the x,y, z coordinates 
associated with a consecutively captured series of linear 3-D surface 
profile maps (I.e. stored in first FIFO memory storage structure)in order to 
construct a 3-D polygon-mesh surface representation of said arbitrary 3-D 
object surface, represented by S L Dip(x,y,z) and having (i) vertices 
specified by x,y, z in local coordinate reference system RpLiiM/cartesian > and 
(ii) planar polygon surface patches s,(x,y,z) and being defined by a set of 
said vertices. 



STEP 8: At the Image Processing Computer, convert the x'Y.z' 
coordinates of each vertex in the 3-D polygon-mesh surface 
representation into the local Cartesian coordinate reference system 
R PLiiM/cartesian symbolically embedded within the PLIIM-based imager. 



STEP 9: At the Image Processing Computer, specify the x\y\ z' 
coordinates of each i-th planar polygon surface patch s(x,y,z) represented 
in the local Cartesian coordinate reference system RpuiM/cartesian, so as to 
produce a set of corresponding polygon surface patch {Sj(x\y\z')} 
represented in system R PLiiM/cartesian 



STEP 10: At the Image Processing Computer, for a selected linear high- 
resolution 2-D image captured at photo-integration time period AT Kl and 
spatially corresponding to one of the linear 3-D surface profile maps 
employed at Step 7, use the camera (IFD) parameters used and recorded 
(i.e. captured) during the corresponding photo-integration time period in 
order to construct a 3-D vector-based "pixel ray" model specifying the 
optical formation of each pixel in the linear 2-D image, wherein a pixel ray 
reflected off a point on the arbitrary 3-D object surface is focused through 
the camera's image formation optics (i.e. configured by the camera 
parameters) and is detected at the pixePs detection element in the linear 
image detection array of the IFD (camera) subsystem. 



FIG. 23C3 
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STEP 1 1 : At the Image Processing Computer, for each laser beam ray 
(producing one of the pixels in said selected linear 2-D image), (i) 
determine which polygon surface patch S|(x, y, z) the pixel ray intersects, 
(ii) compute the x.y, z coordinates of the point of intersection (POI) 
between the pixel ray and the polygon surface patch represented in 
Cartesian coordinate reference system RpuiM/cartesian . and ("') designate 
the computed set of points of intersection as {p.(x,y,z)}. 



K 



STEP 12: At the Image Processing Computer, for each laser beam ray 
passing through a determined polygon surface patch s(x',y', z') at a 
computed point of intersection p.(x, y, z), assign the intensity value l(x'.y') 
of the pixel ray to the x', y', z' coordinates of the point of intersection, 
thereby producing a linear high-resolution 3-D image comprising a 2-D 
array of pixels, each said pixel pixel having as its attributes (i) an Intensity 
value Kx'.y'.z") and (ii) coordinates x', y\ z' specified in the local Cartesian 
coordinate reference system R p L uM/cartesian • 



STEP 1 3: Put the computed linear high-resolution 3-D image in a third 
FIFO memory storage structure in the image processing computer. 



STEP 14: Repeat Steps 1 -6 to update the first and second FIFO data 
queues maintained in the image processing computer, and Steps 7-13 to 
update the consecutively computed linear high-resolution 3-D image 
stored in the third FIFO memory storage structure. 



-N 



STEP 15: Assemble in an image buffer in the image processing 
computer, a set of consecutively computed linear high-resolution 3-D 
images retrieved from the third FIFO data storage device so as to \*^® 
construct an "area-type" high-resolution 3-D image of said arbitrary 3-D 
object surface. 



FIG. 23C4 



STEP 16: At the Image Processing Computer, map the intensity value 
l(x\ y', z') of each pixel in the computed area-type 3-D image onto the 
x'y.z 1 coordinates of the points on a uniformly-spaced apart "grid" 
positioned perpendicular to the optical axis of the camera subsystem (i.e. 
to model the 2-D planar substrate on which the forms of graphical 
intelligence was originally rendered), wherein said mapping process 
involves using an intensity weighing function based on the x*, y\ z 1 
coordinate values of each pixel in the area-type high-resolution 3-D 
image, thereby producing an area-type high-resolution 2-D image of the 
2-D planar substrate surface bearing said forms of graphical intelligence 
(e.g. symbol character strings). 



STEP 17: At the Image Processing Computer, use said OCR algorithm to 
perform automated recognition of graphical intelligence contained in said 
area-type high-resolution 2-D image of said 2-D planar substrate surface 
so as to recognize said graphical intelligence and generate symbolic 
knowledge structures representative thereof. 



STEP 18: Repeat Steps 1-17 as often as required to recognize changes ^-R 
in graphical intelligence on the arbitrary moving 3-D object surface. 



FIG. 23C5 
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Specify object detection and tracking capabilities of PLUM- based network , system, 

and/or subsystem. 



± - 

Specify object identification capabilities of PLIIM-based network , system, and/or 

subsyst ems. 

i 

Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 

or subsystem. 



Determine the configuration of hardware components required to build the configured 
system or network. 

^ 

Determine the configuration of software components required to build the configured 

system or network. 



± 

The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 



_ Y 

The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 



_± 

Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 

with or without remote sen/ice assistance made available through the remote 
monitoring, configuring, and sen/icing system of the present invention, illustrated in 

Figs. 30A through 30D2 



FIG. 25C 
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Use an Internet-enabled client computer to establish a network 
connection (via network router) with an HTTP server in the tunnel- 
based LAN requiring remote monitoring, control and/or service. 



B 



Use an Internet-enabled client computer to access an RMCS 
management console (GUI) from the HTTP server and display the 

same. 
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'ork. 




Use the RMCS management console to monitor the configuration 
and other monitorable parameters of each subsystem in the system. 
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Use the RMCS management console to run a diagnostic program to 
trouble shoot any performance problems with the system. 



Using information collected by the diagnostic program and the 
RCMS management console, reconfigure selected parameters in 
the system and instruct any hardware repairs that may be required 

at the LAN location. 



FIG. 30D1 
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Use the RMCS management console to rerun diagnostic programs 
on troubled systems and subsystems in the LAN after parameter 

reconfiguration and/or hardware repair at the LAN location, so as to 
test the performance of such systems and subsystems and the 
overall tunnel based LAN. 



Use the RMCS management console to monitor parameters of the 
system and subsystems in the tunnel based LAN, from time to time, 
to determine whether or not the system 
and/or network tunnel is required. 



Use the RMCS management console to record all monitored 
parameter records and result of diagnostic programs in a customer 
service database for future reference, and access during 
subsequent remote service calls over the Internet. 



FIG. 30D2 




For each package transported through tunnel system, master unit (with package dimensioning 
subsystem and velocity detection subsystem) generates package height, width, length and 
velocity data {H,W,L,V} Q , referenced with respect to global coordinate reference system 
R . and transmits such package cfimension data to each slave unit downstream, using the 
system* s data communications network. 
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Each slave unit receives the transmitted packag 
and converts this coordinate information into th 


r 

a height, width and length data {H,WJL,V} a 
e slave unit's local coordinate reference system 
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The camera control computer in each slave unit uses the converted package height, width, 
length data {H,WJ-}j and package velocity data to generate camera control signals for driving 
the camera subsystem in the slave unit to zoom and focus in on the transported package as it 
moves by the slave unit, while ensuring that captured images having substantially constant 
OP J. Resolution and 1:1 aspect ratio. 



B 



FIG. 32A 



Each slave unit captures images acquired by its intelligently controlled camera subsystem, 
buffers the same, and processes the images to decode bar code symbol identifiers represented 
in said images, and/or to perform optical character recognition (OCR) hereupon. 



The slave unit which decodes a bar code symbol in a processed image automatically transmits 
a package identification data element (containing symbol character data representative of the 
decoded bar code symbol) to the master unit (or other designated system control unit 
employing data element management functionalities) for package data element processing. 



Master unit time-stamps received package identification data element, places said data 
element in a data queue, and processes package identification data elements and time-stamped 
package dimension data elements in said queue to link each package identification data 
element with one said corresponding package dimension data element 
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Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board the aircraft by the passenger. ^ 
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Upon checking in with this station, the Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment to 
each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the system at 
the check-in station, a passenger/baggage information record in the Passenger and 
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The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger s scheduled flight. 


1 


r 



The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in station automatically captures (i) a digital image of the 
passenger s face, head and upper body, (ii) a digital profile of his or her face and head 
(and possibly body) using the LDIP subsystem employed therein, and (iii) a digital 
image of the passenger s identification card(s). Other biometric information 
acquisition devices provided at the passenger check-in station can be used to acquire, 
from each passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the reliable identification of the 
passenger. 



Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through the tunnel-type package 
identification, dimensioning and tracking subsystem installed before the entry port of 
the X-radiation baggage scanning subsystem (or integrated therewithin), and is then 
conveyed through the X-radiation baggage scanning subsystem. As this scanning 
process occurs, each bar coded article of baggage is automatically identified, imaged, 
and dimensioned/profiled by package identification, dimensioning and tracking 
subsystem and then imaged by x-radiation scanning subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station is 
co-indexed with the corresponding baggage identification (BID) number, and stored 
in the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated therewithin), and is then conveyed through the EDS. 



At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 



Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



FIG.68P2. 



Conventional methods of detecting suspicious conditions revealed by x-ray images of 
baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray scanning 
subsystem) 




f 



Intelligent information processing algorithms can be used to automatically operate on 
each passenger and baggage attribute record stored in the Passenger and Baggage 
Attribute RDBMS 



Passenger attribute information stored in remote intelligence RDBMSs can be 
accessed and used with passenger and baggage attribute information in the Passenger 
and Baggage Attribute RDBMS in order to detect any suspicious conditions which 
may given concern or alarm about either a particular passenger or article of baggage 
presenting concern or a breach of security. 



Such post-check-in information processing operations can also be carried out on 
passenger and/or baggage attribute information stored in the Passenger and Attribute 
RDBMS and/or in remote intelligence RDBMSs on a wide area network (WAN) or 
local area network (LAN) with human assistance, if necessary, to determine if a 
breach of security appears to have occurred. 



If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then the 
flight crew and pilot can be informed by radio communication of the detected 
security conce rn . . 



Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board the aircraft by the passenger. ____ 
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Upon checking in with this station, the Passenger Identification (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID barcode symbol for attachment to 
each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the system at 
the check-in station, a passenger/baggage information record in the Passenger and 
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The passenger identification (PID) bracelet 
passenger s person at the passenger check- 
entire duration of the passenger s schedule* 


(or identification badge) is affixed to the 
in station which is to be worn during the 
i flight. 



The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in station automatically captures (i) a digital image of the 
passenger s face, head and upper body, (ii) a digital profile of his or her face and head 
(and possibly body) using the LDIP subsystem employed therein, and (iii) a digital 
image of the passenger s identification card(s). Other biometric information 
acquisition devices provided at the passenger check-in station can be used to acquire, 
from each passenger checking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information, voice pattern information, facial pattern 
information, DNA partem information) to assist in the reliable identification of the 
passenger. 



Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 
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Each BID bar coded article of baggage is conveyed through the tunnel-type package 
identification, dimensioning and tracking subsystem installed before the entry port of 
the X-radiation baggage scanning subsystem (or integrated therewithin), and is then 
conveyed through the X-radiation baggage scanning subsystem. As this scanning 
process occurs, each bar coded article of baggage is automatically identified, imaged, 
and dimensioned/profiled by package identification, dimensioning and tracking 
subsystem and then imaged by x-radiation scanning subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station is 
co-indexed with the corresponding baggage identification (BID) number, and stored 
in the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated therewithin), and is then conveyed through the EDS. 



At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 



Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Conventional methods of detecting suspicious conditions revealed by x-ray images of 

K 1 baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray scanning 

subsystem) 
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Intelligent information processing algorithn 
each passenger and baggage attribute recon 
Attribute RDBMS 


F 

is can be used to automatically operate on 
i stored in the Passenger and Baggage 




r 


Passenger attribute information stored in remote intelligence RDBMSs can be 
accessed and used with passenger and baggage attribute information in the Passenger 
and Baggage Attribute RDBMS in order to detect any suspicious conditions which 
may given concern or alarm about either a particular passenger or article of baggage 
presenting concern or a breach of security. 




r 


Such post-check-in information processing 
passenger and/or baggage attribute inform* 
- RDBMS and/or in remote intelligence RD 
local area network (LAN) with human ass 
breach of security appears to have occurre 


t operations can also be carried out on 
ition stored in the Passenger and Attribute 
3MSs on a wide area network (WAN) or 
istance, if necessary, to determine if a 
d. 



If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then the 
flight crew and pilot can be informed by radio communication of the detected 
security concern. 
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